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Abstract 



We consider the problems of chaos in disorder and temperature for coupled 
copies of the mixed p-spin models. Under certain assumptions on the parameters of 
the models we will first prove a weak form of chaos by showing that the overlap is 
concentrated around its Gibbs average depending on the disorder and then obtain 
several results toward strong chaos by providing control of the overlap between two 

+-> 



systems in terms of their Parisi measures. 
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1 Introduction and main results. 

oo . 

Q\ . The phenomenon of chaos in disorder and temperature in spin glasses was discovered 
in [5] and [I] and has been studied extensively in the context of various models in the 
physics literature (e.g. see [T7] for a recent review). In recent years, several mathematical 
results have also been obtained. An example of chaos in external field for the spherical 
Sherrington-Kirkpatrick model was given in [IB] , chaos in disorder for mixed p-spin models 
with even p > 2 and without external field was considered in [2] , [3] (among many other 
results) and a more general situation in the presence of external field was handled in [4]. 
In this paper we will develop an approach to chaos in disorder and temperature for mixed 
p-spin models which is based on a novel application of the Ghirlanda-Guerra identities [6J 
used here to derive a new family of identities in the setting of the coupled systems. At 
the moment, our approach only works under certain assumptions on the parameters of 
the models but these new examples are still welcome considering paucity of the results in 
this direction. Given N > 1, let us consider pure p-spin Hamiltonians Hn^ p ((t) for p > 1 
indexed by er E Sv = { — 1, +1} JV > 

Hn, p {<t) = jy(p-i)/2 Yl 9ii,...,ip<7ii ■ ■ ■ <?ip, (!) 

l<il,...,i„<N 
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where random variables (g^,...^) are standard Gaussian independent for all (ii,...,i p ) 
and p > 1. The covariance of this Gaussian process can be easily computed and is given 
by 

iE^^ 1 )^^ 2 ) = (i?(o-\<7 2 )) p , (2) 

where quantity R{<j 1 ,<j 2 ) = N^ 1 J2iLi * s called the overlap of spin configurations 
tr 1 , a 2 e S^. Let us define a mixed p-spin Hamiltonian by a linear combination 

H n (<t) = J2PpH N>p (<7) (3) 

p>i 

with coefficients (/3 P ) that decrease fast enough to ensure that the process is well defined, 
for example, J2 p >i ^ p Pp < °°- The Gibbs measure Gtv(ct) on E jv is defined by 

expH N (a) 
Un{(t) = ^ , 

where the normalizing factor Zn is called the partition function. The behavior of the 
Gibbs measure is intimately related to the computation of the free energy iV -1 log Zn in 
the thermodynamic limit and, as a result, has been studied extensively since the ground- 
breaking work of G. Parisi in [9], [10]. In particular, various physical properties of the 
Gibbs measure, such as ultrametricity and lack of self-averaging, implied by the choice of 
the replica matrix in the Parisi ansatz were discovered by the physicists in the eighties 
(see [8 J for detailed account). The chaos problem, or "chaotic nature of the spin-glass 
phase" pp, arose from the discovery that, in some models, small changes in temperature 
or disorder may result in dramatic changes in the location of the ground state with the 
energy max ff Hn(ct), as well as the overall energy landscape and the organization of the 
pure states of the Gibbs measure Gn- One very basic way to define such instability of the 
Gibbs measure is to sample a vector of spin configurations a from Gn and a vector p from 
the measure G' N corresponding to the perturbed parameters and consider their overlap 
R(cr,p). The fact that this overlap behaves very differently than the overlap R(<r l ,cr 2 ) 
of two replicas er 1 , a 2 sampled from the same measure G^ indicates that the set of con- 
figurations in Sjv on which the Gibbs measure concentrates (the location of pure states) 
is affected significantly by a small change of parameters. A typical statement that one 
is looking for in this case is that the overlap R(cr, p) is concentrated near zero when the 
model has symmetry or, more generally, near a constant when the symmetry is broken, 
for example, in the presence of external field. Indeed, this behavior is quite different 
from a typical "lack of self-averaging" when the overlap between er 1 and er 2 can take 
many different values for any realization of the disorder in the low temperature phase. 
Moreover, even if we could show that the overlap R(cr, p) concentrates near its Gibbs' 
average which depends on the disorder, this would already indicate some form of chaos for 
exactly the same reasons. This is precisely what we will show in the case of perturbations 
of the disorder and for some perturbations of the inverse temperature parameters (/3 P ). 
Furthermore, under additional assumptions on the sequence (/3 P ) we will provide stronger 
control of the overlap in terms of the Parisi measures of the two systems. 
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We will consider two systems with Gibbs' measures G l N and G 2 N corresponding to the 
Hamiltonians H\ j (ct) and Hfj(p) as in fl3]) for cr, p E Sjy defined in terms of possibly differ- 
ent sequences of parameters and {0^) and, again, possibly different Gaussian disorders 
(0ii,...,ip) and (#L--,* P ) for P > 1- However, we will assume that all pairs (gj } ^ ip , gl,..., ip ) 
are jointly Gaussian and independent for all (z'i, . . . ,i p ) and p > 1. We will denote by 
(er z , p l )i>i an i.i.d. sequence of replicas from the measure G]^ x G 2 N and by (•) the Gibbs 
average with respect to (G l N x G 2 N )®°°. 

Weak forms of chaos. For j E {1,2} let us denote 

X| = { p e 2N ■. fi± o}, x; = {p e 2N - 1 : %± 0} 

and let Xj = X? U X°. When we talk about chaos in disorder we will assume that the 
following condition about their correlation is satisfied for at least one p > 1, 

p E Xx n X 2 and corrG^...^, gl_ ip ) = t p E [0, 1) (4) 

for all (zi, . . . , i p ). Our first result yields a weak form of chaos in disorder. 

Theorem 1. If (Q) holds for some even p > 2 i/jen 

lim E({\R(cr,p)\-(\R( ( T,p)\)) 2 )=0. (5) 

If (fj]j /ioWs /or some ooW p > 1 then 

hm E((i2(<r,p) - (R(cr, p))) 2 > = 0. (6) 

For example, for pure 3-spin model, the overlap R(cr, p) is concentrated around its Gibbs 
average (R(cr,p)) and for pure 2-spin (SK) model, the absolute value of the overlap 
\R((T,p)\ is concentrated around its Gibbs average (\R(er, p)\). If i p = 1 in (jlj) for all 
p > 1, we can prove a weak form of chaos in temperature under certain assumptions on 
the sequences (f3p) and (P 2 ). Let us introduce a family of subsets of natural numbers, 

Co = jx C N : linear span of (x p ) p& x is dense in (C[0, 1], || • ||oo) }• (7) 

Let us define the following conditions on the sequences and ((3%): 

(CI) either X| \ If ^ or there exist A C Xf and p £ X| \ ^4 such that .4. G C and for 
some rGlwe have /3 p = r/3p for p E A and 7^ 

(C?) either X° \ If ^ or there exist A C X° and p G X° \ ^4 such that ieC and for 
some reRwe have f3 2 = r(3p for p E A and /3p o 7^ T/3p , 

and let us define (C|) and (Cj) in the same way by flipping indices {1, 2}. We will define 
conditions 

(C°) = (C?) A (C°), (C e ) = ((CI) V (C?)) A ((Ct) V (CS)). (8) 

The role of (jTJ) and condition A E C will be to ensure the validity of the extended 
Ghirlanda-Guerra identities from the identities for moments. The following weak form of 
chaos in temperature holds. 
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Theorem 2. Condition (C e ) implies |3]) and condition (C°) implies (Ej). 

Example 1. If X x = {3} and X 2 = {5} then © holds. If 2i = {2} and X 2 = {4} or 
X 2 = {3} then (|5J holds. 

Example 2. If X 1 =X 2 = 2N, $ = /?f and r /3p = /Sj for all even p > 4 and r ^ 1 then p 
holds. 

Example 3. If Zi = {2} and X 2 = 2N + 2, then P holds. 

Toward strong chaos. To formulate the results that provide some strong control of the 
overlap R(<r, p) we need to recall some consequences of the validity of the Parisi formula 
for the free energy in mixed p-spin models, which was proved in [19] for even-spin models 
using the replica symmetry breaking interpolation idea from [7] and in [15] in the general 
case using ultrametricity result from [T4]. The first consequence that was found in [20] 
(see [H] or [21] for a simplified proof) states that the Parisi formula is different iable in 
the inverse temperature parameters (3 P for all p > 1 which together with convexity implies 
that for all p G X l5 

lim E/i^W 2 )) = / g p c//ii(g), (9) 

N-+00 J Q 

where \i\ is any probability measure on [0, 1] that achieves the minimum in the variational 
problem that defines the Parisi formula. Any such \i\ is called a Parisi measure of the 
system. Similarly, for all p G X 2 , 

lim E(R p (p\p 2 ))= [ fdin(q) (10) 

for any Parisi measure /x 2 of the second system. Another consequence of the Parisi formula 
will be the strong form of the Ghirlanda-Guerra identities proved in [12] that will be used 
in the next section. In the situations that we consider below the linear span of {x p ) p& x- 
will be dense in (C[0, 1], || • ||oo) for one or both j = 1, 2 in which case Q), (TTDT) imply that 
the Parisi measure fij is unique. In this case let 

Cj = inf supp fj,j 

be the smallest point in the support of fij. The following result provides some control of 
the overlap and points toward strong chaos in disorder. 

Theorem 3. If holds for some p > 1 and XJ G Co for j = 1 or j = 2 then 

lim E(l(\R(<r,p)\> y /c-)) = 0. (11) 

JM — too 

If holds for some odd p > 1 and X e - G Cq for both j = 1 and j = 2 then 

lim E(l(\R(a,p)\ > y^)> = 0. (12) 

In particular, if the Parisi measure fij of the system that satisfies XJ G Cq contains zero 
in its support then the overlap R(cr, p) concentrates around zero. Again, if t p = 1 in (T4|) 
for all p > 1, we have a similar result for chaos in temperature. 
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Theorem 4. If ZJ G Co /or j = 1 or j = 2 i/ien condition (C e ) implies 07]) . and i/ 
2J e Co /or 6o£/i j = 1 and j = 2 then condition (C°) implies $TB). 

Finally, all our results also hold for the spherical mixed p-spin models when S^r is the 
sphere of radius y/~N with uniform measure, as long as X\ UX 2 C 2NU{1}. This restriction 
is due to the fact that the Parisi formula for the spherical model has so far been proved 
only for such models in |18j . 



2 Ghirlanda-Guerra identities for coupled systems. 

In this section we will show how one can use the Ghirlanda-Guerra identities for each 
system in the form of the concentration of the Hamiltonian to obtain a new set of identities 
for the overlaps of the coupled system. First of all, condition (jlj) means that the Gaussian 
pair (g 1 ,^ 2 ) is equal in distribution to 

for three independent standard Gaussian random variables g, z 1 ,^ 2 and, therefore, the 
pair of processes (a) and (p) is equal in distribution to the pair 



t p H N>p {cr) + a/1 - T p Z x Np {a) and ^H N , p (p) + y/T 



where we denote by H^ tP , Zj^ and Z\j p three independent copies of (CQ). Let us consider 
the quantities 
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The Ghirlanda-Guerra identities [6] in the form of the concentration of the Hamiltonians 
can be stated as follows. 



Lemma 1. For all p > 1, we have A p , A 2 , r*, T 2 — > 0. 

Proof. Notice that in the definition of A* we are averaging the Hamiltonian Z% p from 
the second system over the first coordinate cr 1 , which means that it is independent of 
the randomness in (•). Therefore, if we denote by E' the expectation with respect to 
the randomness Zjy then E(Z]y (er 1 )) = E(E'Z7v, p (cr 1 )) = and, using (j2J) and Jensen's 
inequality, 
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We conclude that A* — > and, similarly, A 2 — > 0. On the other hand, as we mentioned in 
the introduction, the validity of the Parisi formula for the free energy and the argument 
in [12] (see also Chapter 12 in [21]) imply that 1^ — >■ and r 2 — >• which is the usual 
formulation of the Ghirlanda-Guerra identities in the form of the concentration of the 
Hamiltonian. 

□ 

Given replicas (cr l , p l )i>\ let us denote by 

R\ v = R{*\ a 1 '), R\ v = R(p l , p 1 '), R u , = R(<r l , p 1 ') 

the overlaps within each system and between the two systems. Notice that with these 
notations the cross overlap is not symmetric, Riji ^ Rv,i- Given integer n > 1, a function 
■0 G C [— 1, 1] and a bounded measurable function / of the overlaps (i?^,); i //< n , {R^ v )i^< n 
and (Ri t ii)i t ii<n on n replicas, we define 



1 1 - 

<& liB (/, ^) = nw{R\, n+ x)) - -nf)m(R\,2)) - -Y, E WW)> 

1=2 

1 - 

*!,„(/, V) = E(/^(i2i, n+ l)> " -2 E <M^1,0), 

Z=l 

1 1 71 

$ 2 ,„(/^) = WO) - -E(/)E(0« 2 )) - -£E(/^(^)) ; 

' n n z — ' 

Z=2 

1 n 

* 2 , n (/,V) = E</V(iW,i)> - -y><Mi2,,i)>. 



(13) 
(14) 
(15) 
(16) 



z=i 



Throughout the paper we will use the notation 

ip p (x) = x p . 

The following lemma contains a computation based on the Gaussian integration by parts 
analogous to the one for the original Ghirlanda-Guerra identities [6] for one system. 

Lemma 2. For all p > 1 we have, 

sup /^a/ 1 _ *p*i,»(/ 5 V> P ) 



sup 

ll/l|oo<l 

sup 

ll/l|oc<l 



sup 

/lloc<l 



< 



< 



A} 

n 

A 2 

p 

• 

n 
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(17) 
(18) 
(19) 
(20) 
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In particular, Lemma [T] implies that all the quantities on the left hand side go to zero and, 
under certain assumptions on the parameters of the models, this will imply that some or 
all quantities in f fl3|) - ffT6|) go to zero. Equations f lT3|) and f JT5|) will yield the familiar 
Ghirlanda-Guerra identities, only now the function / may depend on the overlaps of the 
two systems. Furthermore, equations pijl and ( TT6l) will provide important additional 
information about how the two systems interact with each other. 

Proof. We will only show flTTJ) and (fl9|) since the proof of (Tl8|) and (1201) is similar. As 
usual, we begin by writing that for \\f\\oo < 1, 



fZ 2 Nv {<J l ) 
E( — — -f 
\ N J 



and 



E 



/)-E 



\ AT 



N J I \ N 
Using (T5]) and Gaussian integration by parts we get 



<K 



< r 1 . 



(21) 



(22) 



\ AT 



1=1 



and since E(Zjy ) = 0, (|2T|) implies (|T71) . Similarly, using Gaussian integration by parts, 



E 



N 



/3 P 1 (1-E((it! 1 1 )2 f» 



and 



E 



H 



N,p 



1=1 

n 

+ /3 p %(^E<(i? M ) p /> -nE{(R lin+l ff) 
i=i 

Therefore, (12"2"I) implies (TT^|) and this completes the proof. 

We will use Lemmas [1] and [2] in combination with the following result. 
Lemma 3. Let j 6 {1,2}. Suppose that 

lim sup \y jjn (f,ip)\ = 



7V-s>oo 



(23) 



ll/l|oo<l 



/ioWs wift ip = ip p for some p > 1. If p > 2 is even then a/so /io/ds for all even 
ip E C[— 1, 1] and z/p > 1 is odd Z/ien ( flg|) /io/ds /or a// t/> G C[-l, 1]. 

Proof. It suffices to prove the results for j = 1. For all Z > 2 (using symmetry), 
E<(( J R 1 , 1 ) P - (i?i,/) p ) 2 > = 2E<( J R 1 , 1 ) 2p > - 2E((R 1 , 1 )>(R 1 , 2 )>) = -2^> X)1 {f^ p ) 
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by definition of ^i tU in (I14p with n = 1 and / = (i?i,i) p . If p > 2 is even then using that 
|sc — y\ p < |a; p — ?/ p | for all x, y > we can write 

Edl^l - \R ltl \\) < {E(\\R hl \ - | J R 1 , i || 2p » 1/2p (24) 

If ( 123]) holds for ip = ip p , this implies that \Ri t i\ ~ |-Ri,i| for all / > 2 and, therefore, ( 123]) 
holds for all even ^ G C[— 1, 1]. Whenever (12"3"]) holds for if) = ip p and odd p > 1 we use 
the same argument and the fact that \x — y\ p < 2 p ~ l \x p — y p \ for all x, y G M to show that 
R^i « i2 M for all / > 2 and, therefore, ((23]) holds for all ip G C[-l, 1]. 

□ 

We are ready to state several consequences of Lemmas [1]- [3] under additional assumptions 
on the parameters of the models that appear in our main results. First, we consider the 
condition (j4j) that is used to prove weak chaos in disorder. 

Proposition 1. Suppose that ^ holds for some p > 1. For j G {1,2}, if p is even then 
||3|) holds for all even ip G C[— 1, 1] and if p is odd then |I3j) holds for all ip £ C7[ — 1, 1] . 



Proof. Since under (B| , (3 p , (3 p ^ and t p < 1, equations f|T7|) . ffl~8]) and Lemma [T] imply 
that ( f23l holds with ip = ip p for both j G {1, 2}. The statement follows from Lemma [3j 

□ 

One can prove a similar result under the conditions (IE]) that appear in the results con- 
cerning chaos in temperature. 

Proposition 2. Suppose that t p = 1 for all p > 1. For j G {1,2}, condition (C e ) implies 
H3|) /or a// even V e C[— 1, 1] and condition (C°) implies [23\) for all ip G C[— 1, 1]. 



Proof. The result will follow immediately from the definition of (C e ) and (C°) in (JHJ) if 
we can show that 

(i) (Cf) implies ([23]) for j = 1 and even ^ G C[-l, 1], 

(ii) (C?) implies ([23]) for j = 1 and all ip G C[-l, 1], 

(iii) (C|) implies ([23]) for j = 2 and even ^ G C[-l, 1], 

(iv) (Cf) implies ([23]) for j = 2 and all ip G C[-l, 1]. 

We will only prove (i) since all other cases can be treated similarly. Let us show that (CI) 
implies 

lim sup \*i, n (f,il> po )\ = (25) 

N -+°° ll/l|cx.<l 

for some even p > 2 from which ( 123]) for j = 1 and even if) G C[— 1, 1] follows from 
Lemma [31 First, if we suppose that X?, \ Xf ^ then there exists some even p > 2 such 
that /9p o ^ and (3 po = 0, and 025]) immediately follows from f[T§]) . Next, suppose that 
there exist ^4 C and p E Xf\A such that .A G C and for some r G R we have (3 p = rf3 p 
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for p G A and (3p Q ^ T t^l - Since (3p o ^ 0, let ftij ' =: r' ^ r. Lemma [T] and equation 
([19]) imply that 

lim sup |$i, n (/, ^ po ) + r'* 1)n (/, V P0 )| = (26) 

JV->0 ° ll/l|oo<l 

and for p G A (using that 0^ = r(3p and (3^ ^ 0), 

lim sup |$i,„(/, V P ) + r*i, n (/,V P )| = 0. 

iV - >QO ||/||oo<l 

Since .4. G Co, we can approximate ?/Vo uniformly by ip p for p G >A to obtain 

lim sup |$i in (/,^ )+^i,n(/,^o)l = 0. (27) 



JV->-oo 



,<1 



Since r' 7^ r, (1261) and (1271) again imply ( 1251) and, thus, (Cf) implies (1231) for j = 1 and 

even ^ G C[-l, lj. 

□ 

Now that we obtained control of quantities ^j >n , equations ( Fl9~j) and (120]) can be used to 
control 

Proposition 3. Suppose that 0) Zioids for some p > 1. For j G {1, 2}, &/XJ G Co i/ien 

lim sup |$,- n (/,V)| = (28) 



,<1 



/or a// even ^ G C[— 1, 1]. 

Proof. Let us only consider the case j — 1. By Proposition (TJ ( )23|) holds for all even 
if) G C[— 1, 1] and, therefore, equation (!T9l) and Lemma [U imply that 

lim sup |$i,„(/, Vp)| = 

for all p G Xf. Since If G Co, we can approximate even ip G C[— 1, 1] by polynomials with 
powers pelj and (12 8j) follows for j = 1. 

□ 

Exactly the same proof using Proposition [2] instead of Proposition [1] gives the following. 

Proposition 4. Suppose that t p — 1 /or aZZ p > 1. For j G {1,2}, z/XJ G C i/ien either 
condition (C e ) or (C°) implies 



3 Proof of the main results. 

As an immediate consequence of Propositions [T] and [2] we get Theorems [T] and [2J 
Proof of Theorems [1] and [2]. Suppose that either (j3j) holds for some even p > 2 or 
condition (C e ) holds. By Propositions [T] and [21 (J22]) holds for all even ip G C[— 1, 1] for 
both j G {1,2} and flUD implies 

lim E<(|F Llil |-| J R 1 , 2 |) 2 )=0. 
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An argument similar to 023]) also gives 

lim E((\R 2>2 \-\R lt2 \) 2 ) = 0. 

Equation ((SJ) follows by writing 

E((\R hl \ - (li?!,!!)) 2 ) < E((\R hl \ - \R 2 , 2 \Y) 

< 2E((\R 1A \ - |# li2 |) 2 ) + 2E((|i? 2 , 2 | - |i? li2 |) 2 >. 

If either (jlj) holds for some odd p > 1 or condition (C°) holds then, by Propositions [1] and 
EJ (1231) holds for all if) G C[— 1, 1] and a similar argument yields (jSJ). 

□ 

Let us denote by /ijv the distribution of the array of all overlaps 

{^i,v)i,v>ii (.R\v)i,i'>i and (Ri,i')i,v>i (29) 

under the annealed Gibbs measure E(G\ r x G^)® 00 . By compactness, the sequence (/xjv) 
converges weakly over subsequences but, for simplicity of notation, we will assume that 
converges weakly to the limit \i. We will still use the notations (129"]) to denote the 
elements of the overlap array in the limit and, again, for simplicity of notations we will 
denote by E the expectation with respect to measure /i. For example, whenever (12 8j) 
holds, the measure fi will satisfy the Ghirlanda-Guerra identities 

EMR{ n+1 ) = -EfEif){R{ 2 ) + (30) 

1=2 

for all bounded measurable functions / of the overlaps on n replicas and even if) e C[— 1, 1]. 
Consequently, (1301 also holds for all even bounded measurable functions if). Similarly, (jSJ) 
implies that //-almost surely \Rij'\ = \Ri,i\ and implies that /x- almost surely Riy = Ri t i 
for all I, I' > 1. Given /j, let /ii, /i 2 and //i j2 denote the distributions of \R\ 2 |, |i2? 2 | and 
under /i correspondingly (we will abuse the notations since, indeed, below the distributions 
of |-R 12 |, |-R 2 2 | will coincide with the Parisi measures in (jUJ), (TTUT) ) . Given measurable sets 
A±, A 2 C [0, 1] and A C [—1, 1] let us define the events 

£ n = {i^ e A, E A l for Z ^ Z' < n, e A 2 for Z ^ Z' < n} (31) 

and 

C n = ji?! ! e A, \Rl )V \ e A x for / ^ Z' < n + 1, e A 2 for Z ^ Z' < nj (32) 

The following lemma will be crucial in the proof of Theorems [3] and HI 
Lemma 4. //// satisfies [3fy) for j = 1 and A 2 = [0, 1] then 

M(C„) > Mi(^i)>i l2 (A). (33) 
// /i satisfies K3fy) for j = 2 and Ai = [0, 1] i/ien 

v(B n ) > /i 2 (A 2 )"-Vi,2(A). (34) 
// /i satisfies for both j = 1 and j = 2 then 

KB n ) > ( f J ll (A 1 )fi 2 {A 2 )) n - 1 {^(A). (35) 
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Proof. Let us prove the following claim: If /x satisfies (I30p for j = 1 then 

KC n ) > fi^AtMBn) (36) 
and if \x satisfies (I3(jp for j = 2 then 

M#n+i) > ^(A 2 )fx(C n ). (37) 



First, we prove f[36|) . We will use a computation similar to Lemma 1 in [13]. For any 
n > 1 we can write 



I Cn >lB n -Y, I BMKn + l\i (3* 

Kn 

For all 1 < Z < n, equation ( l30i) for j = 1 implies (using symmetry) 

1 1 n 

E/ Bn /(|4 n+1 | g Ai) = -^(AtUB n ) + -J2®IbJ(\RIA i A,) 



n n 

i//i(A5)/i(s n ) 

n 



and, therefore, (136]) follows from ( 138|) . In order to prove ( 13~T|) . let us start with 

I Bn+1 > I Cn -SWM £ A 2 ). (39) 



Kn 



First of all, let us notice that using the definition of the event C n and symmetry we can 
write for I < n, 

EI Cn I(\Rl n+l \ i A 2 ) = EI c J(\Rl n+2 \ i A 2 ). 

Using (130]) for the right hand side with j = 2 and n + 1 instead of n (notice that C n 
depends on the first n + 1 replicas), 

1 1 n+1 

E/ Cn /(|it? )n+1 | £ A 2 ) = -—^ 2 {Al)n{C n ) + J2 EI cJ(K>\ i A 2 ) 

' n + 1 71 + 1 ^— ' 



n + 

Therefore, for 1 < I < n, 



-inWMCn) + —m G j(\Ri n+1 \ i a 2 ). 



EI c J(\Rf n+1 \ i A 2 ) = -^(A C 2 )^(Q 



n 



and ( 1371) follows from ( 139|) . Now suppose that ( 130]) holds for j = 1 and A 2 = [0, 1]. In 
this case, C n = B n+1 and /i(Ci) = /ii(A 1 )/i 1 2 (A) using (130]) with n = 1. By induction, 
inequality (|36|) yields 
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which proves (I3"3"j) . Now, suppose that (l3"Uj) holds for j = 2 and A\ = [0, 1]. Then C n = B n 
and by induction fl37|) implies f l34"|) . Finally, suppose that f l30]) holds for both j = 1 and 
j = 2 and let us prove fl35|) by induction. First, it us easy to see that /i(-Bi) = /ii i2 (A). 
Suppose that ( |35l) holds for some n > 1. Then using ( |37l) . ( |36l) and induction hypothesis, 

p(£ n +i) > fJL 2 {A 2 )ti{C n ) > fi 1 {A 1 )fi 2 {A 2 )^(B n ) 

> m(Ai)ii 2 (A 2 ) (jJn(A 1 ) f i 2 (A 2 )) n - 1 fi 1>2 {A) = (^i(Ai)^2(A 2 )) n ^ 1)2 (A). 

This completes the proof. 

□ 

Proof of Theorems [3] and |4l Let us first prove the first part of the statements of 
Theorems [3] and HI For certainly, let us assume that X\ G C - In this case (jHJ) implies that 
in the limit the distribution of \R\ 2 | coincides with the unique Parisi measure fi\. Suppose 
that either (J4]) holds for some p > 1 or, if not, condition (C e ) holds. Then Propositions [3] 
and H] imply that the identities (1301) holds for j = 1. Moreover, as we mentioned above, 
Theorems [TJ and [2] imply that 

f A(\R 1)1 \ = \R i ,v\,Vl,r>l) = l. (40) 

Let us show that the identities f[3"Uj) for j = 1 together with (HHj) imply (fTTj) . that is, 

lim E</(| J Ri. 1 |> v ^)> = 0. (41) 

iv— >-oo 

Suppose that (HT]) is not true. Then there exists some c > v /c7 such that 

// li2 ([-l,-c)U(c, 1]) >0. 

Since C\ is the smallest value of the support of /ii, there exists some c with c\ < c < c 2 
such that /^i([0, c )) > 0. Set A = [-1, -c) U (c, 1], A x = [0, c ) , and A 2 = [0, 1] . Recall 
the definition of C n from ([32]). Using (J33]), we know that //(C n ) > ( / ui(Ai))> lj2 (A) > 
for each n > 1. Let us consider the event 

<7 n = {R lA G A for Z < n + 1, \Rli,\ G A l for I ^ /' < n + l}. 

By fj40|) . fi(C n ) = fi(C n ) and, since C* n is an open subset on the space of overlaps, 

liminf /i N {C n ) > fi(C n ) = //(C„) > 0. 

N— >oo 

This means that for any n > 2, for large enough N, we can find cr 1 , cr 2 , . . . , cr n G £jv an d 
p 1 G XV such that \R(cr l ,p 1 )\ > c for I < n and \R(cr l , er l ')\ < c for I ^ V < n. Let us 
choose d, . . . , a n G {—1, 1} such that aiR(cr l , p 1 ) = \R(cr l , p x )| for I < n. Then 

iV" 1 | (aio- 1 + a 2 cr 2 + • • • + a n cr n } p 1 ) | = ^ |_R(o-', p 1 ) | > nc 

l<l<n 

and 

^"^[aicr 1 + a 2 cr 2 H \- a n er n \\ 2 = ^ aia v R{cr l , cr 1 ') < n + (n 2 - n)c . 

l</,Z'<n 
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Using the Cauchy-Schwarz inequality, we obtain that 

nV < N^l^cr 1 + a 2 cr 2 H h a n a n ,p l )\ 2 

< N~ 2 \\ai(j l + a 2 cr 2 H h a n <r n || 2 ||p 1 || 2 < n + (n 2 - n)c . 

If we divide both sides by n 2 and let n — > oo we get c 2 < Co which contradicts the choice 
of Co. This completes the proof of ffTT|) . Next, we prove ffT2l assuming that ZJ G Co for 
both j = 1 and j = 2. In this case, the Parisi measures fii and [i 2 are again the limiting 
distributions of \R{ 2 \ and |i? 2 2 |, respectively. Suppose that either (jl]) holds for some odd 
p > 1 or (C°) holds. By Propositions [3] and HI the identities ( 130]) are satisfied for both 
j = {1,2} and, by Theorems [TJ and [21 

li(Ri,i = Ri,i>M> 1) =1. (42) 

We prove (fT2l by contradiction. Assume that there exists some c > ^c\c 2 such that 

fi lt2 ([-1, -c) U (c, 1]) > 0. 

Let us discuss the case //i j2 ((c, 1]) > first. Choose d\ and d 2 satisfying c\ < di < 1, 
c 2 < d 2 < 1, and \/did 2 < c. If we define Ax = [0,di), A 2 = [0,d 2 ) and A = (c, 1] then 
Hi(Ai) > and /i 2 (A 2 ) > 0. If we recall the event B n in fl3T|) . fl35l) implies that /x(-B n ) > 0. 
If we consider the event 

B n = {R l>r E A for I, I' < n, G A 1; G A 2 for / ^ /' < n) 

then by f j42l) . /i(B n ) = n(B n ), and since B n is an open subset on the space of overlaps, 

liminf fi N {B n ) > fi{B n ) = fi(B n ) > 0. 

This implies that for any n > 2, if A^ is sufficiently large, we can find cr l , . . . , cr n G Sjv 
and p\ . . . , p n G Sjy such that ^(ct', /) G A for /, V < n, \R(er l , G A x for Z ^ V < n 
and |-R(p', p l ')\ G A 2 for l^V <n. Therefore, 

A^- 1 ||cr 1 + o- 2 + --- + cr™|| 2 = R{°\° 1 ') < n + {n 2 - n)d 1 , 

l,l'<n 

N- 1 \\p 1 + p 2 + --- + p n \\ 2 = R (P l , P 1 ') <n + (n 2 - n)d 2 



LV<n 



and 



N- 1 \(<T 1 + * 2 + --- + <T n ,p 1 + P 2 + --- + p n )\ = \Y J R(°\P V ) 



Ll'<n 



> n 2 c. 



Using the Cauchy-Schwarz inequality as above, 

n 4 c 2 < (n + [n 2 — n)d\)(n + [n 2 — n)d 2 ). 

Since this is true for every n, dividing both sides by n 2 and passing to the limit, it 
implies c < \Jdid 2 which contradicts the choice of d\ and d 2 . This completes the proof in 
the case fii, 2 ((c, 1]) > 0. One can check that the same argument yields the result when 
/ii j2 ([— 1, — c)) > and this finishes the proof. 
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